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(54) Parameter adaptation in evolution strategies 

(57) The present invention relates to a optimization 
method based on an evolution strategy according to 
which a model/structure/shape/design to be optimized 
is described by parameter sets comprising object pa- 
rameters. The object parameters are mutated to create 
offsprings of the parameter set. The quality of the off- 
springs is evaluated. The parameter set furthermore 



comprises at least one strategy parameter representing 
the step-size of the mutation (f.e. the variance of the nor- 
mal distribution) of associated object parameters. The 
number of object parameters as weii as the number of 
associated strategy parameters can be adapted during 
the optimization process. The value of newly inserted 
strategy parameters can be estimated based on the in- 
formation of correlated object parameters. 
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Description 



[0001] The present invention relates to an optimization method based on an evolution strategy, to a method for 
optimizing spline coded structures on the basis of an evolution strategy, to a computer software for executing such a 
s method as well as to the use of such a method for the optimization of the shape of aerodynamic or hydrodynamic 
structures. 

[0002] In the field of evolution strategy, basic principles of natural evolution are used for generating or optimizing 
technical structures. Basic operations are mutation and recombination as a method for modifying structures or param- 
eters. To eliminate unfavorable modifications and to proceed with modifications which increase the overall quality of 
10 the system, a selection operation is used. Principles of the evolution strategy can be found for example in Rechenberg, 
Ingo (1994) "Evolutionsstrategie", Friedrich Frommann Holzboog yeriag. 

[0003] With reference to figure 1 at first the known cycle of an evolution strategy will be explained. 

[0004] In a step 1 the object parameters to be optimized are encoded as real numbers in a vector called individual 

or chromosome. One individual can alternatively also consist of several vectors or chromosomes. A number of such 

is individuals are generated that comprise the initial parent generation and the quality (fitness) of each individual in the 
parent generation is evaluated. In a step S2 the parents are reproduced by applying operators called mutation and 
recombination. Thus, a new generation is produced in step S3, which is called the offspring generation. The quality of 
the offspring individuals is evaluated using a fitness function which is the objective of the optimization in step S4. Finally, 
depending on the calculated quality value, step S5 selects (possibly stochastically) the best offspring individuals (sur- 

20 vival of the fittest) which are used as parents for the next generation cycle if the termination condition in step S6 is not 
satisfied. 

[0005] In particularforthis application the real number vector the object parameter, represents the codingfor a spline 
which describes a two or higher dimensional body. This mapping from the parameter vector to the spline encoded 
structure is usually referred to as the genotype (=the parameter vector) - phenotype (=the two or higher dimensional 

25 body) mapping. In order to determine the fitness in step S4, first the genotype is mapped to the phenotype and then 
the quality of the phenotype is derived. A particular example is the parameterization of an airfoil (=the phenotype) by 
a real-valued vector (= genotype) describing a spline which determines the geometry of the airfoil. Finally, the quality 
of the airfoil can be determined, e.g. by methods known from computational fluid dynamics. 
[0006] The mutation operator forthe reproduction in step S2 is realized by adding normal or Gaussian distributed 

30 random numbers to the already existing elements of the parameter set, the so-called chromosome. The step size of 
the mutation can be controlled by modifying the variance of the normal or Gaussian probability density function. The 
variances are called strategy parameters. In higher dimensions the strategy parameters can consist of all or some 
entries of the covariance matrix of the higher dimensional Gaussian probability density function. This method to control 
the mutation by means of strategy parameters particularly distinguishes evolution strategy from other evolutionary 

35 algorithms like genetic algorithms (GA) or genetic programming (GP). 

[0007] Appropriate values for the strategy parameters are important for the convergence of the algorithm. The ap- 
propriate values depend on the problem and the actual position in the solution space. To adapt the mutation width 
online, different adaptation strategies are used. Some simple methods are the 1/5 rule (see Rechenberg) or the so- 
called mutative step size control. More complex methods are, for example, the de-randomized adaptation method or 

•fo the co-variance matrix adaptation. 

[0008] Evolution strategies have been shown to outperform other evolutionary algorithms like genetic algorithms or 
genetic programming for real-valued parameter optimization problems due to the above-mentioned possibilities of the 
adaptation or self-adaptation of the step size(s) of the mutation operator. 

[0009] A known problem for the application of evolution strategy to design optimization is that the number of param- 
45 eters which describe the model (the so-called object parameters) is fixed in evolution strategy. Therefore, an automatic 
refinement of the phenotype represented by the object parameters during the optimization is impossible. 
[0010] Mathematically, the mutation operation step can be expressed by the following equation (1): 



50 




(1) 



thereby x° represents the parameter set of the offspring, x p represents the parameter set of the parents and 
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represents a vector whose elements are normal distributed random numbers with zero mean with variances o>, 2 . As 
can be seen from Fig. 3, a larger strategy parameter c P j increases the probability for larger steps in the offspring 
mutation. 

[001 1] More generally, the mutation operation can be represented by the following equation (2): 



5 




(2) 



wherein 



10 



15 




(3) 



[001 2] Fig. 3a and b show the resulting probability distribution for placing an offspring, wherein Fig. 3a shows a 3D- 
plot and 3b shows a contour-plot. S is a random vector with a general Gaussian probability density function as specified 
in Eq. (3), if the covariance matrix X is diagonal, Eq. (2) is reduced to Eq. (1) where the elements of the vector (o>), 
the variances o F , 2 , are the diagonal elements of 2. 

[0013] The covariance matrix 2 has to be adapted to the local quality function. Fig. 4d shows the self-adaptation of 
the strategy parameters (covariance matrix X) to the local quality function. Particularly, Fig. 3c shows the result of four 
cycles of the reproduction process, wherein the 3d surface represents the quality function. By the self-adaptation of 
the strategy parameters to the local quality function regarding the direction and the step size a good convergence 
towards the absolute maximum of the local quality function can be achieved. 

[0014] It is the object of the present invention to deal with the problem of variable parameter set length in evolution 
strategy in particular in context with the self-adaptation property of the strategy parameter set. With other words, the 
present invention proposes a technique for automatically refining the phenotype described by the parameter set during 
the optimization. 

[0015] This object is achieved by means of the features of the independent claims. The dependent claims develop 
further the central idea of the present invention. 

[0016] According to the present invention, the size of the describing parameter set during the evolution process can 
be adapted. For example, in the beginning a very small parameter set can be used to find a rough approximation of 
the optimal shape, which can be achieved very fast. During the optimization, the parameter set can be expanded to 
describe more and more complex shapes. However, the parameter set can not only be changed by inserting new object 
parameters and appropriate strategy parameters, but also by removing some parameters. This can be the case f.e. if 
an object parameter shows to be not sufficiently useful for further optimization. 

[0017] When expanding the number of object parameters in the parameter sets, the associated number of strategy 
parameters has also to be expanded by inserting new strategy parameters. The present invention therefore proposes 
a technique for estimating the value of newly inserted strategy parameters. 

[0018] According to a first aspect of the present invention therefore an optimization method based on an evolution 
strategy is proposed. A model, structure, shape or design to be optimized is thereby described by a parameter set 
comprising object parameters which are mutated and/or recombined to create offsprings of the parameter set. The 
quality of the offspring is then evaluated. The parameter set furthermore comprises at least one strategy parameter 
representing the variance of the mutation of associated object parameters. Thereby, the number of object parameters 
as well as the number of associated strategy parameters can be adapted during the optimization process. 
[001 9] For example the object parameters and strategy parameters can be selectively inserted and/or removed. 
[0020] The value of a newly inserted strategy parameter can be estimated based on the information of strategy 
parameters of correlated object parameters. 

[0021] The position and/or the time of a removal or an insertion of an object parameter and an associated strategy 
parameter can be determined by a random function. 

[0022] The changes of the object parameter set and the associated strategy parameters can be performed such that 
it has no influence on the result of the evaluation step, thus the change of the parameters can be selectively neutral. 
[0023] According to a further aspect of the present invention, an optimization method based on an evolution strategy 
is proposed. Thereby the structure of a parameter set defined by the number and/or position of the object parameters 
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and strategy parameters can be mutated to create these offsprings. 

[0024] According to a still further aspect of the present invention, a method for the optimization of spline coded 
problems is proposed. The object parameters in this case can comprise control and knot points, wherein new control 
points and strategy parameters can be inserted. 
s [0025] The values of newly inserted strategy parameters can be estimated on the basis of the values of the strategy 
parameters of neighboring control points. 

[0026] According to a further aspect of the present invention, a method for optimizing spline coded shapes on the 
basis of an evolution strategy is proposed. Thereby a model, structure, shape or design to be optimized is described 
by a parameter set comprising object parameters representing control points and knot points of the spline coded shapes 

io and at least one strategy parameter representing the variance of the mutation of associated object parameters. The 
object parameters and strategy parameters are mutated to create offsprings of the parameter set. Finally, the quality 
of the offsprings is evaluated. According to the invention, the step of mutating comprises the step of determination of 
a control point insertion position, insertion of the control point, adjustment of the knot vector, insertion of the appropriate 
strategy parameter for the inserted control point, weighted averaging of the strategy parameter values of the modified 

15 control points, and assigning the weighted average value as the value of the inserted strategy parameter. 

[0027] According to a further aspect of the present invention, a computer software program for executing a method 
as said above is proposed. 

[0028] Finally, the invention proposes the use of such a method for the optimization of the shape of aerodynamic or 
hydrodynamic structures. 

20 [0029] Further features, objects and advantages of the present invention will become evident for the man skilled in 
the art when reading the following description of embodiments of the present invention when taken in conjunction with 
the figures of the enclosed drawings. 

Fig. 1 shows a schematic representation of an evolutionary algorithm. 

25 

Fig.2 is a graphic representation showing the influence of the strategy parameter value. 

Fig.3 shows the relation between the strategy parameter and the direction and step size of the evolution strategy 
process. 

30 

Fig.4 shows schematically the structure mutation for individual step size adaptation of the strategy parameter. 
Note, that the neighboring control points and strategy parameters might also be affected by the structure mutation. 

Fig.5 shows schematically the structure mutation for the covariance matrix adaptation of the strategy parameter. 
35 Note, that the neighboring rows and columns in the covariance matrix might also be affected. 

Fig.6 shows a flow-chart for the process of adapting the structure of a parameter set by inserting/removing strategy 
and object parameters. 

40 Fig.7 shows different hierarchies of mutations. 

Fig.8 is a schematic flow chart showing the mutation of the structure of a parameter set. 

Figs.9 and 1 0 show an application example of the present invention: the optimization of spline coded shapes. 

45 

Fig. 11 shows the application of the present invention to the optimization of the shape of an aerodynamic or hy- 
drodynamic body. 

[0030] The principles of evolution strategy have already been explained with reference to Figs. 1 to 4. The general 
so difference between the present invention and the prior art in evolution strategy is that the structure of the genotype, i. 
e., the structure of the parameter set including the strategy parameters, can also be mutated. With other words, both 
the number of object parameters and strategy parameters of a parameter set can be changed. Therefore, the optimi- 
zation process can start with a relatively low number of parameters and the complexity of the parameter set can be 
refined during the optimization process 
ss [0031] With reference to Figs.4 and 5, the time point and/or the location for the insertion of a new object parameter 
in the existing parameter set can be defined for example by means of a random function. When inserting a new object 
parameter, at the corresponding location of the strategy parameters a new strategy parameter is inserted such that 
the old "chromosome" (parameter set comprising object parameters and strategy parameters) is extended to a new 
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chromosome. The concept shown in Fig.4 refers to the so called individual mutative step size adaptation. Note, that 
neighboring object and strategy parameters might also change after the modification. 

[0032] The structure mutation of the covariance matrix is schematically shown in Fig.5. The strategy parameter 
according to this embodiment is represented as the covariance matrix £ (see equation (3) further above). When inserting 
5 a new object parameter in the old chromosome to create an extended chromosome, the covariance matrix Z is adapted 
by inserting a new row and a new column, thus generating a new expanded covariance matrix Z. The parameter set 
according to this representation is composed of the object parameter set and the strategy parameter, e.g. the co- 
variance matrix Z. Note, that neighboring rows and columns of the covariance matrix might be affected by the modifi- 
cation. 

io [0033] The present invention is for example applied to the field of optimization of spline coded problems. An example 
of a spline coded problem is shown in Figs. 1 0 to 1 2. Typically in such spline coded problems, all attributes of the shape 
are encoded in the parameter set (control points, knot points which comprise the object parameters and the strategy 
parameters). Attributes which are not encoded cannot be represented and therefore cannot be subject of the optimi- 
zation. As a consequence thereof, attributes cannot evolve during the optimization as long as they are not included in 

is the parametric description of the parameter set. 

[0034] The present invention now allows for an online modification of the parametric description (modification of the 
structure of the genotype) in order to allow new attributes in the encoding and therefore also in the shape (=the phe- 
notype) to be inserted. Note, that the parameter set can not only be expanded by inserting new object and strategy 
parameters, but also be reduced by removing these parameters. This can be the case f.e. if an object parameter shows 

so to be not sufficiently useful for further optimization. 

[0035] As has already been said, one of the main advantages of the evolution strategies compared to other evolu- 
tionary algorithms is the use of the strategy parameters which can represent a preferred direction and step size for a 
further search. The strategy parameters are also adapted (mutated) in evolution strategies during the optimization to 
the local properties of the quality function. When new components (new control points in the case of spline coded 

25 problems) are inserted in the encoding orthe encoding is modified, the values of the newly inserted strategy parameters 
have to be calculated. 

[0036] According to the present invention, when determining a value of a newly inserted strategy parameter, the 
information of correlated components, e.g. the information of correlation parameters associated with correlated object 
parameters is used. 

so [0037] In the case of spline encoded structures, strategy parameters of new points are usually similar to strategy 
parameters of their neighboring points. Therefore, in the case of spline encoded structures, the strategy parameter 
value can be estimated from the strategy parameter values of neighboring control points. 

[0038] The optimization process for a spline encoded problem or structure can therefore be represented in a simple 
way as follows: 

35 

definition of an initial spline encoding (object parameter set) for the geometric shape (for example hydrodynamic 
or aerodynamic bodies such as an airfoil) and of an initial strategy parameter set (f.e. covariance matrxi) 
performing the steps of a standard evolution strategy for optimization 

introducing (possibly at random) new control point(s) in the spline encoding (new parameters) due to any predefined 
40 measure, f.e. stagnation of improvement with current encoding or as an additional mutation operator 
estimation of the new strategy parameter values based on existing strategy parameters, and 
continuation of the standard evolution strategy for optimization. 

[0039] This process usable for example for spline encoded problems will now be explained with reference to Fig. 6. 

45 [0040] In step S1 the initial encoding of the problem, for example represented by control and knot points, is set. In 
step S2 it is decided whether the encoding should be mutated. This decision can for example be triggered by a random 
function or a function that depends on the progress of the optimization. In case the result of step S2 is yes, in step S3 
it is decided whether a new control point is to be inserted. If the answer of the decision step S3 is yes (which can be 
again decided on the basis of a random function or some kind of sensitivity analysis of the spline coding), the position 

so for the newly to be inserted control point has to be found in step S4. Therefore the index / of the newly to be inserted 
point representing the position of the newly inserted point in the parameter set has to be found in step S4 and the new 
control point is inserted at the index / in step S5. Finally in a step S6, the value of the correspondingly to be inserted 
strategy parameters sfraf, is calculated. The value of the newly inserted strategy parameters sfrat,-is af unction f(strat H , 
strat M ) of the values of the neighboring strategy parameters /'- 1 and i+1 or in more general terms a function of a subset 

55 of all old strategy parameters. 

[0041] In case it is decided in step S3 to mutate the coding without insertion of a new control point, the removal 

position has to be chosen in step S7 and the corresponding control point is removed in step S8. 

[0042] Finally, the parameter set including the control points, knot points and strategy parameter is mutated in step 
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S9. The resulting structure of this mutation step S9 is then evaluated in step S10 using a so-called fitness function, f. 
e. measuring the fluid-dynamics properties of the spline coded shape. 

[0043] In step S11, it is checked whether all individuals, i.e., all parameter sets (comprised of the object parameters 
and the strategy parameters) have been mutated. If this is not the case, the process goes back to step S2. 

s [0044] If the decision in S11 is positive, the n best individuals out of the m individuals generated in step S9 and 
evaluated in step S10 are selected in step S12 ("survival of the fittest"); this corresponds to a (n,m) selection, other 
selection methods like (n+M) or tournament selection, etc. can be applied. After the selection process, the optimization 
is either stopped, S13, in case some pre-defined criterion has been reached or a new generation is started with the 
reproduction step in S14 and a new mutation step in S1. 

10 [0045] Fig. 7 shows the different hierarchies of mutations possible according to the present invention. 

[0046] The mutation of the parameter set (object parameters S15 and strategy parameters S16) in a step S9 is 
already known. However, according to the present invention, also the structure, e.g. the number and position of the 
object parameters and strategy parameters of the parameter set can be mutated in a step S1 7 (comprising the steps 
S2 to S8 in Fig. 6). 

'5 [0047] Fig. 8 summarizes the optimization processing as shown in Fig. 6. The genotype is first extended by inserting 
a new object parameter in step S3a. The value of this new parameter is estimated from the existing object parameter 
values in step S3b, f ; e. in order to minimize the initial variation of the phenotype following the extension of the genotype. 
Once the position and the value of the new object parameter has been calculated in steps S3a and S3b, the position 
and the value of the new strategy parameter is calculated using already present strategy parameters corresponding 

so to the object parameters used in the estimation of the value for the new object parameter (step S3b). 

[0048] Finally, an extended genotype with optimized strategy parameters forthe new object parameters is generated. 
[0049] A simple example forthe application of the present invention on a spline encoded structure is shown in Figs. 
9 and 1 0. The problem in this case is the approximation of a circle by a polygon with a fixed (Fig.9) and a variable (Fig. 
10) number of edges. The present invention (Fig. 10) has the advantage that this simple optimization process can be 

25 started with a structure with few parameters, f ,e. a triangle, whose number is subsequently increased during the opti- 
mization. Due to the iterative development the evolution does not get stuck like in Fig.9, where the degree of freedom 
is too large for the strategy parameters to adapt. 

[0050] The mutation process for such spline encoded structures can be summarized as follows: 
30 1 . Based on a simple structure (small number of object parameters), a control point insertion position is determined. 

2. The control point is inserted at the determined insert position. 

3. The knot vector is changed according to the inserted control point. 

35 

4. To calculate the value of the new strategy parameter for the new control point, a weighted averaging of the 
strategy parameters of the neighboring control points is performed, and 

5. The weighted average value is assigned as value for the new inserted strategy parameter. 

40 

[0051] According to the description, the present invention finds application for all structure encodings in which the 
optimal strategy parameter can be estimated from already existing strategy parameters. 

[0052] Fig. 11 visualizes the estimation of strategy parameters and the application of the present invention to the 
design of airfoils. R5 thereby designates the airfoil. Ft6 designates the control polygon forthe spline which approximates 

45 the airfoil. R9 designates an already present control point and the ellipsoid R1 0 around this control point, R9, visualizes 
the probability density distribution according to the strategy parameter which is the expected area for modification. R7 
designates a new inserted control point having a strategy parameter R8 represented by the gray-shaded area. 
[0053] Further examples forthe application of the present invention apart from airfoil shapes are compressor/turbine 
blades for gas turbines (stator and rotor blades) and other aerodynamic or hydrodynamic structures. Other fields of 

so application are architecture and civil engineering, computer science, wing design, engine valve design and scheduling 
problems. 



Claims 

55 

1. Optimization method based on an evolution strategy, comprising the following steps: 

a model, structure, shape or design to be optimized is described by a parameter set comprising object param- 
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eters, 

the object parameters are mutated and/or recombined to create offsprings of the parameter set, 
the quality of the offsprings is evaluated, 

s wherein the parameter set furthermore comprises at least one strategy parameter representing a step-size of the 

mutation of associated object parameters, 
characterized in that 

the number of object parameters as well as the number of associated strategy parameters can be adapted (S2) 
during the optimization process. 

to 

2. Optimization method according to claim 1 , 
characterized in that 

object parameters and strategy parameters can be selectively inserted (S4-S6) and/or removed (S7). 

15 3. Optimization method according to claim 1 or 2, 
characterized in that 

the value of a newly inserted strategy parameter is estimated (S6) based on the information of strategy parameters 
associated with correlated object parameters. 

20 4. Optimization method according to any one of the preceding claims, 
characterized in that 

the position and/or the time of a removal or insertion of an object parameter and an associated strategy parameter 
is determined by a random function. 

25 5. Optimization method according to any one of the preceding claims, 
characterized In that 

the position and/or the time of a removal or insertion of an object parameter and an associated strategy parameter 
is determined by the progress of the evolutionary optimization. 

30 6. Optimization method according to anyone of the preceding claims, 
characterized in that 

the structure mutation of the object parameters and the associated strategy parameters is performed such that it 
has no direct influence on the result of the evaluation step (S10). 

35 7. Optimization method based on an evolution strategy, comprising the following steps: 

a model, structure, shape or design to be optimized is described by a parameter set comprising object param- 
eters, 

the object parameters are mutated (S9, S1 5, S1 6), to create offsprings of the parameter set, 
40 - the quality of the offsprings is evaluated (S1 0), 

wherein the parameter set furthermore comprises at least one strategy parameter representing the step-size of 
the mutation (f .e. the variance of the normal distribution) of associated object parameters, 
characterized in that 

45 furthermore the structure of a parameter set defined by the number and/or position of the object parameters and 

strategy parameters is mutated (S1 7) to create said offsprings. 

8. Method for the optimization of spline coded structures/shapes/designs, 
characterized in that 

so it comprises a method according to anyone of the preceding claims. 

9. Method according to claim 8, 
characterized in that 

the object parameters comprise control and knot points and in that new control points and strategy parameters 
5 5 can be inserted (S3) and the knot vector is adapted accordingly. 

10. Method according to claim 9, 
characterized in that 
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the values of newly inserted strategy parameters are estimated (S6) on the basis of the values of the strategy 
parameters of neighboring control points. 

11 . Method for optimizing spline coded problems on the basis of an evolution strategy, comprising the following steps: 

5 

a model, structure, shape or design to be optimized is described by a parameter set comprising object param- 
eters representing control points and knot points and at least one strategy parameter representing the step- 
size of the mutation (f.e. the variance of the normal distribution) of associated object parameters, 
the object parameters and strategy parameters are mutated (S9, S15, S16) to create offsprings of the set, 
'0 - the quality of the offsprings is evaluated (S1 0), 

characterized in that 

the step of mutating comprises the steps of 

,s - determination (S4) of a control point insertion, 

insertion (S5) of the control point in the parameter set, 

insertion of a strategy parameter for the inserted control point, 

determination of the knot points modified by the insertion of the control points, 

weighted averaging (S6) of the strategy parameter values of the modified control points, and 

50 - assigning the weighted average value as the value of the inserted strategy parameter 

12. Computer software for executing a method according to anyone of the preceding claims. 

1 3. Use of a method according to anyone of claims 7 to 1 1 for the optimization of the shape of aerodynamic or hydro- 
's dynamic structures. 
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